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ABSTRACT 

Summary.  For  A  C  ,  we  say  that  a  set  A  C  Rd  is  A-convex  if  the 
segment  pq  is  contained  In  A  whenever  p,  q  e  A  and  p  -  q  e  A.  For  the 

control  system  x(t)  -  G(x(t) )#u(t) ,  x(o)  ■  0  e  Rd ,  u(t)  e  Q  C  Rm  for  every 
t  e  [ 0,T] ,  assuming  that  the  reachable  set  R(T)  Is  A-convex,  an  extension 
of  the  Pontryagln  Maximum  Principle  Is  proved.  If  x(u,T)  lies  on  the 
boundary  of  R(T),  conditions  on  the  first  order  tangent  cone  at  x  (u,T)  can 
indeed  be  combined  with  restrictions  placed  on  finite  difference  vectors  of 
the  form  y  -  x(u,T),  with  y  e  R(T) ,  y  -  x(u,T)  e  A.  11118  result  is 
complemented  by  conditions  insuring  the  directional  convexity  of  the  reachable 
set.  They  rely  on  a  uniqueness  assumption  for  solutions  of  the  Pontryagln 
equations  and  are  proven  by  means  of  a  generalized  Mountain  Pass  Theorem. 

AMS  (MOS)  Subject  Classifications:  49E15,  58E25,  93C10 

Key  Words:  Directional  convexity.  Critical  point,  Nonlinear  control  system, 
Necessary  Conditions  for  optimality. 
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SIGNIFICANCE  AND  EXPLANATION 


Consider  a  control  system  of  the  form 


x  (t)  =  g. (x<t) )u,  (t)  ,  x(o)  ■  0  e  Rd, 
i=1 


u(t)  =  (u.(t),  u  <tn  e  ncif1  vt  e  [o,t], 
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Assume  that  an  admissible  control  u(*)  steers  the  system  to  a  point  x(u,t) 
on  the  boundary  of  the  reachable  set  R(t).  Then,  by  studying  the  variations 
x(u,t)  -  x(u,t)  for  controls  u  which  are  infinitesimally  close  to  u,  one 
concludes  that  u  must  satisfy  the  Pontryagin  Maximum  Principle. 

This  paper  establishes  further  necessary  conditions  for  optimality,  by 
considering  finite  difference  vectors  of  the  type  y  -  x(u,t),  y  being  any 
point  in  R(t),  not  necessarily  close  to  x  (u,t).  These  conditions  are 
significant  whenever  the  reachable  set  is  a  priori  known  to  be  directionally 
convex.  More  precisely,  we  say  that  R(t)  is  A-convex  if  a  segment  pq  is 
entirely  contained  in  R(t)  whenever  its  end  points  p,q  lie  in  R(t)  and 
the  direction  of  p-q  falls  inside  a  preassigned  cone  of  directions  A.  An 
efficient  method  for  determining  the  A-convexity  of  a  reachable  set  is 
developed. 

The  major  application  of  the  present  results  appears  in  [3],  where  they 
are  used  to  determine  the  local  time-optimal  stablizing  controls  in  a  generic 
3-dimensional  problem. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


DIRECTIONAL  CONVEXITY  AND  FINITE  OPTIMALITY  CONDITIONS 
Alberto  Bressan* 


1.  Introduction. 

Consider  a  control  system  of  the  form 

i(t)  -  G(x(t))u(t),  x (o )  -  0  e  Rd,  (1.1) 

where  G  Is  a  dxm  matrix  with  continuously  differentiable  entries  and  the  control  u 
lies  In  the  admissible  set 

0  -  {u  -  e  2{{0,T]i  *B)  i  u( t )  e  a  a.e.},  (1.2) 

i  in 

ft  being  a  fixed  compact  convex  subset  of  tf" •  Given  a  control  u  e  0,  let  t  ♦  x(u,t) 

be  the  corresponding  solution  of  (1.1)  and  call  R(t)  the  reachable  set  at  time  t. 
Several  necessary  conditions  are  known  in  order  for  a  trajectory  x(u,«)  to  reach  a 
boundary  point  of  R (T)  at  time  T  [2.7,81.  All  of  these  conditions  are  obtained  from  a 
local  analysis)  to  test  the  optimality  of  a  control  u(*),  a  one-parameter  family  of 

control  functions  Uj.  ( • )  is  constructed,  which  generates  at  time  T  a  tangent  vector 

v  -  lim  [x!uf,T>  -  x(u,T)]/5. 

1*0  K  (1.3) 

If,  by  choosing  different  families  of  controls  ( •  ) ,  one  can  generate  tangent  vectors 

d 

v1#  ....  vR  whose  positive  span  is  all  of  R  ,  then  it  can  usually  be  shown  that 
x(u,T)  lies  in  the  interior  of  R(T).  In  the  present  paper  we  consider  not  only 
infinitesimal  tangent  vectors  of  the  form  (1.3),  but  also  finite  difference  vectors: 

w  »  y  -  x(u,T)  ( 1.4) 

where  y  is  any  point  in  R(T).  Assume  that  there  exist  first  order  tangent  vectors 
Vp...,vn  and  finite  difference  vectors  Wj,  ....  wy  such  that  the  positive  span  of 
{vj,  ...,  vn,  Wj,  ....  w^}  is  all  of  R**»  The  a-priori  assumption  that  R  (T)  is  convex 
would  then  imply  x(u,T)  e  int  R(T). 
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Unfortunately,  in  a  nonlinear  setting  such  an  assumption  Is  far  too  restrictive  for  moat 


of  the  relevant  applications.  A  less  stringent  condition  is  the  following  kind  of 
directional  convexity: 

Definition.  Let  A  be  a  subset  of  R^.  A  set  A  C  ij  A-convex  if  p,  q  6  A  and 

p  -  q  6  A  imply  Ep  +  (1-E)q  e  A  for  all  E  e  [0,11. 

Using  the  notion  of  A-convexity  we  obtain  an  extension  of  the  Pontryagin  Maximum 
Principle  for  the  system  (1.1). 

Theorem  1.  Assume  that  the  reachable  set  R (T)  is  A-convex  for  some  A  £  Rd.  Let 

u  e  U  be  a  control  such  that  x(u,T)  lies  on  the  boundary  of  (T).  Then  there  exists 
a  nontrivial  adjoint  vector  X ( • )  such  that 

X(t)  ■  -X(t)  •  G^fxfu.t))  *  u(t),  (1.5) 

<  A(t),  G(x(u,t) )u(t)  >  =  max  {<X (t) ,G(x(u,t) )*u>  »  u  e  0) 

a.e.  in  [0,T],  (1.6) 

<  X (T) ,  y  -  x(u,T>  >  <  0  (1.7) 

for  all  y  e  R(T)  such  that  y  -  x(u,T)  lies  in  the  interior  of  A. 

Here  (1.5)  and  (1.6)  are  a  restatement  of  the  Maximum  Principle,  while  the  non-positivity 

of  the  inner  product  in  (1.7)  poses  an  additional  requirement  whenever  the  A-convexity 

of  the  reachable  set  is  a-priorl  known.  Of  course.  Theorem  1  would  have  little 

significance  unless  we  provide  some  efficient  way  to  determine  the  A-convexity  of  (T) 

for  some  set  A.  This  is  indeed  the  major  concern  of  the  present  paper.  Let  the 

d 

seta  R(t)  be  bounded  for  0  <  t  <  T.  Then  for  all  nontrivial  1  e  R  there  exists  at 
least  one  control  ( «  )  for  which  the  Pontryagin  equations 

£(t)  -  G(x(t) )  u(t) 

X(t)  “  -Aft)  •  Gx<x(t))«u(t)  (1.8) 

x(o)  -  0,  X (T)  -  h 

<  A(t),  G(x(t))u(t)>  «  max  {<A  (t )  ,G(x(t )  )u  >;  u  e  0} 

are  a.e.  satisfied.  Indeed  R (T)  is  compact,  hence  the  problem 


max  <  n,  x(u,T)  > 
u6U 


-2- 


(1.9) 


has  at  least  one  solution.  The  control  un  which  attains  the  maximum  clearly  yields  a 
solution  to  (1.8).  We  will  infer  the  directional  convexity  of  R(T)  from  the  uniqueness 
of  the  solution  of  (1.8)  for  certain  n,  relying  on  a  version  of  the  Mountain  Pass 
Theorem  [1,4).  In  the  following  we  call  w^  the  hyperplane  orthogonal  to  the  vector 
w  e  Rd.  Our  main  result  is 

Theorem  2.  Assume  that  the  reachable  sets  R(t),  0  <  t  <  T,  for  the  control  system 

(1.1)  are  uniformly  bounded.  Then  R(T)  is  A-convex,  A  being  the  set  of  all  w  e  Rd 

such  that  for  every  nontrivial  h  S  W*' 

a)  the  equations  (1.8)  have  a  unique  solution,  say  (u{>),  x(»),  !(•)), 

b)  for  a.e.  t  8  [0,T],  u(t)  is  the  unique  point  in  0  where  the  map 
u  *  <  A ( t ) ,  G( x(t ) ) *u  >  attains  its  maximum. 

Notice  that,  for  the  set  A  defined  in  Theorem  2,  w  e  A  always  implies 
£w  e  A  for  every  (  e  R,  (  /  0.  A  thus  represents  a  family  of  directions.  This 
motivates  the  term  "directional  convexity"  used  throughout  the  paper. 

Hie  major  application  of  the  present  results  appears  in  [2J,  where  the  above  theorems  rule 
out  the  optimality  of  certain  bang-bang  controls  for  which  Pontryagin's  test  is 
inconclusive.  This  leads  to  the  solution  of  the  generic  local  time-optimal  stabilization 
problem  for  systems  of  the  type  x  *  X(x)  +  Y(x)u,  in  dimension  3. 

2.  Preliminaries 

Consider  a  mapping  4  from  a  Hilbert  space  H  into  Rd.  Its  Frechet  differential  at  a 
point  u  e  H  is  denoted  by  D$(u).  We  say  that  ♦  is  if  the  map  u  ♦  Cty(u) 

from  H  into  the  space  of  continuous  linear  operators  L  ( H ;  Rd )  from  H  into  Rd  is 
continuous.  For  the  definition  of  the  operator  norm  on  L(H,Rd)  and  for  the  basic 
properties  of  differential  calculus  in  abstract  spaces  our  general  reference  is  Dieudonne 


[6].  If  f  :  H  ♦  R  is  Mpschitz  continuous,  the  generalized  directional  derivative  of 
f  at  u  in  the  direction  v  is 


f°  (u»v)  »  lie  5  ^flu+Ev)  -  f(u>], 
u*u 
E+0 


and  the  generalized  gradient  of  f  at  u,  denoted  3f(u),  is  the  subdifferential  of  the 

convex  function  v  *  f°(u,v)  at  the  origin  (5}.  Thus  w  e  3f(u)  if,  for  all  v  e  H 

o  — 

<  w,v  >  <  f  (u,v).  if  u  is  a  closed  convex  subset  of  H,  we  denote  by 

r<u)  and  ri(u)  the  tangent  and  the  normal  cone  to  U  at  a  point 

u  6  0.  If  M  >  0  and  dy(v)  denotes  the  distance  from  a  point  v  e  H  to  U,  the 

generalized  gradient  of  the  map  v  ♦  M  •  dy(v)  at  ueU  is 

3(M*du)  (u)  -  {we  r"^ (u) j  Iwl  <  M}.  (2.1) 

He  write  B(x,r)  for  the  closed  ball  centered  at  x  with  radius  r,  int  A  and  cc  A 

for  the  interior  and  the  convex  closure  of  the  set  A.  Consider  now  the  special  case 

where  H  »  i2  ( [0,T]  jrf*) ,  U  is  the  convex  set  defined  at  (1.2)  and  ♦  !  L2  *  R<5  is  the 

map  u(*)  *  x(u,T)  generated  by  (1.1).  Then  $  is  continuously  differentiable  (see  [2] 

for  details)  and  D$(u)  is  the  linear  map 
T 

u(*)  ♦  j  M(T, s)  G(x(u,s) )u(s)ds  (2.2) 

0 

where  s  ♦  M(T,s)  is  the  dxd  matrix  fundamental  solution  of 


z(t)  »  -z(t)  •  Gx(x(u,t) )u(t) 


with 

M(T,T) 

-  I.  Here  Gx  denotes  the  differential  of  the  map  G  :  Rd  ♦ 

Rdx» 

in 

(1.1). 

For 

h  e  R** ,  the  differential  of  the  map  u(*)  *  <  n,  ^fu)  >  at 

u  is 

the 

linear 

nap 

T  _ 

u( •  )  ♦  /  X(s)  G(x(u,s) )u( s )ds ,  (2.3) 

0 

X ( • )  being  the  unique  solution  to 
X(t)  -  -X (t)  Gx(x(u,t) )u(t)  ,  X (T)  -  n 

—  1  —  2 

In  this  case,  if  u(*>  C  U,  T  (u)  is  the  set  of  L  functions  z(*)  such  that 


(2.4) 


vu  e  u, 


(2.5) 


T 

J  c(s)  (u(s)  -  u(a))da  <  0 
0 

3.  Proof  of  Theorem  1. 

Consider  a  control  u  e  U,  and  suppose  that  the  conclusion  of  Theorem  1  does  not  hold  for 
u.  Then  for  every  nontrivial  vector  h  e  Rd  one  of  the  following  alternatives  holds: 

i)  if  !(•)  denotes  the  unique  solution  of  (1.5)  for  which  X(T)  *  n>  then 
X(t)  G(x(u,t) )u(t)  <  max  (X(t)G(x(u,t) )u»  u  C  0} 

for  t  in  a  subset  J  £  (0,T]  of  positive  measure,  or 

ii)  there  exists  some  y  C  (T)  with 

w  "  y  -  x(u,T)  e  int  A  and  <  h«  y  ~  x(u,T)  >  >0. 

In  the  first  case,  let  ( • )  be  s  control  in  U  such  that 

X(t)*G(x(u,t)  )Ujj  (t)  »  max  (Xltl'OIxIujt)  )ui  u  e  Q) 

for  a.e.  t  e  [0,T].  For  5  e  (0,1],  the  convex  combination  £u^(*)  +  (1-E)u(»)  is 

again  an  admissible  control.  It  was  shown  in  (2]  that 

v  »  lim  (x(?u  +  (1-C)u,T)  -  x(u,T)]/C 

5*0  n 

is  a  first  order  tangent  vector  whose  inner  product  with  n  is  strictly  positive.  A 
standard  argument  now  implies  that  Rd  is  the  positive  span  of  d  +  1  vectors  :  v1 ,  ..., 
vn,  wj,  ...,  wv  with  the  following  property: 

For  i  ■  1,  ...,  n  there  exists  a  control  u^(»)  (  I)  such  that 


v.  «  lim  (x(Cu.+( 1-C)u,T)  -  x(u,T)]/C  •  D  ♦(u)  •  (u.  -  u) 
1  C*0  1  1 


with  D  +(u)  given  at  (2.2),  and  for  J  *  1,  ...»  v  there  exists  a  point  y^  e  R(T) 
such  that  Wj  ■  y^  -  x(u,T). 

Moreover,  w^  lias  in  the  interior  of  A.  By  constructing  suitable  convex  combinations 
of  the  vectors  v^,  wj  we  will  show  that  the  above  assumptions  imply 


x(u,T)  6  int  R(T).  Define 


,,...cb4v)  eRn+v, 


c.  >  o,  \n  Vc  -  1}  . 
1  i-1  1 


■5' 


Por  c  e  An+V,  C  e  (0,1)  set 

p  (c,C)  »  x((1-C)u  +  ?  l"  c,(u,-u),  T). 

i-1 

By  induction  on  j  «  1,  ...»  v  define 

Pj(c,£)  -  Pj_1(c,C)  +  5cn+j(y^-pj_,(c,C)) 
and  eet  p(c,()  “  pv(c,£).  Let  p  >  0  be  such  that  B(w^,p)  £  A  for  all 
j  -  1,  ...»  v.  Let  N  -  max  {|w^|»  j  -  1,  ...»  v).  Choose  C  >  0  so  snail  that 

£  <  P  (2v(M+p)I  1  and  lp0(c,C)  -  x(u,T)l  <  p/2  for  all  (c,£)  e4n+V  x  [0,O»  An 
easy  inductive  argument  now  yields 
|p^(c,£)  -  x(u,T) |  <  p/2  +  2v  <  P 

for  all  c,  C,  i,  hence  |y^  -  p  ^  -  w^|  <  p.  It  Pj_1(c,5)  e  R(T),  then  also 
p^(c,£)  e  R(T),  due  to  the  A-convexity  of  the  reachable  set*  By  induction  on  j  it 
follows  that  p(c,€)  e  Rtf)  for  all  (c,6)  e  An+V  x  (0,51.  the  continuous  Prechet 

differentiability  of  the  map  A  s  u(*)  *  x(u,t)  implies  that 


PQ(c,0  -  x(u,T) 


Jo  D*(u+C  \n  c.tuj^-u)) 
i-1 


•  c,  (u4-u)dc 
i-1 


-  £  •  D$(u)  •  \n  c  (u.-u) 
i-1  1  1 


+  Jp  [t*(u+c  \n  ci(uJ-u))  -  D+(u)]»  \n  cilui-u)<JC 


i-1 


i-1 


-  £  1"  C  V  ♦  0(0 
i-1  1  1 


(3.1) 


n+v 

with  lim  o( 0/5  -  0  uniformly  w.r.t.  c  e  A  . 
£♦0 

Moreover 


lim  (p.(c,C)  -  p,_.(c»0]/S  ”  c_+1  U® 

^♦0  3  3  3  5*0  3  3 


c  . ,  w, 
n+j  j 


(3.2) 


n+v 

also  holds  uniformly  w.r.t.  c  6  A  •  Together,  (3.1)  and  (3.2)  yield 

lim  (p(c,6)  -  x(u,T) ]/£  “  l”  c.v.  +  1V  c  ,  w. 

£-»0  i-1  j-1  n  3  3 


■6- 


n+v 

uniformly  w.r.t.  c  e  A  .  The  argument  that  completes  the  proof  Is  now  well 
established.  Let  4  be  the  distance  of  0  e  Rd  from  the  boundary  of 
co  {vj , . . . #vn,w1 . . ,wv)  and  choose  £Q  >  0  so  small  that  eQ  <  £  and 


lp<c,eo>  -  x(u,T)  -  c0  <J"  cn+j  w3)|  <  50  • 


4/2 


(3.3) 


for  all  c  e  An+V.  Consider  the  injective  map  o  :  An+V  ♦  Rd  defined  by 

0(C)  -  x(u.T)  +  V  ciVl  +  r  cn+j  Wj>. 

1-1  j“ 1 

Tor  z  e  B( x(u,T) ,  Eq4)  define  F(x)  “  p(o  '(z),  £q).  By  (3.3), 

|r(z)  -  z|  <  CQ«  4/2.  For  each  zQ  e  B(x(u,T),  50  •  4/2),  an  application  of  Brouwer's 

theorem  ((7)  pg.  251)  now  inq>lies  the  existence  of  some  z  e  B(x(u,T),  Cq4 )  for  which 

F(z)  “  z_.  Hence  B(x(u,T),  5  4/2 )  C  R(T),  Q.e.D. 
o  O 


4.  An  abstract  result  on  directional  convexity 

The  additional  condition  (1.5)  stated  in  Theorem  1  is  useful  only  if  one  can  prove  that 
the  reachable  set  R(T)  is  A-convex  for  some  (hopefully  large)  set  A  C  Rd.  Recasting 

the  problem  in  a  more  general  setting,  we  now  examine  the  directional  convexity  of  the 
image  <i(U)  of  a  convex  set  U  under  an  arbitrary  differentiable  map 


Theorem  3.  Let  U  be  a  closed,  convex,  bounded  set  in  a  Hilbert  space  H  and  let  (i  be 

a  C1  map  from  a  neighborhood  of  U  into  Rd,  with  ♦  (U )  compact  and  llhjd  uniformly 

bounded  on  U.  Then  (i(U)  is  A-convex,  A  being  the  set  of  vectors  w  e  Rd  such  that, 

for  every  nontrivial  h  8  w^, 

a')  there  exists  a  unique  u  C  U  for  which 

<  n.  D^(u)  •  y  >  <  0  for  all  y  e  Hu), 

b')  If  U  e  0,  z_  e  r**- (U  )  ,  n  -  1,  2,  ...  and  ln*D<>(u.)  -  z  I  ♦  0,  then  the 

n  n  n  n  n 

sequence  (un)n>1  has  a  convergent  subsequence. 

-7- 


Notice  that  in  condition  b' )  both  z_  and  the  map  v  ♦  <  n»  D*(u  )  v  >  are  continuous 

n  n 

linear  functionals  on  H,  hence  the  norm  of  their  difference  is  well  defined.  To  prove 
the  theorem  let  p*  “  ♦(u‘),  p"  “  $(u")  e  Rd,  u*,  u*  e  U,  p*-p'  -  w  e  A.  If  the  segment 
joining  p*  to  p*  is  not  entirely  contained  in  <i(U),  the  compactness  of  4>(U) 
implies 

B(Cp*  +  d-Op".  p)  n  *((J)  -  9  (4.1) 

for  some  5  e  (0,1),  p  >  0.  Let  IDji(u)l  <  MQ  for  every  u  in  a  neighborhood  UQ  of 

D,  and  extend  from  UQ  to  a  function,  still  called  4>,  defined  and  globally 

Lipschitz  continuous  on  the  whole  space  H,  so  that,  say 

l+fu,)  -  ♦(u2)|  <  M  lu^UjI  W  u^Uj  e  H.  (4.2) 

d 

Let  d^fp)  be  the  distance  of  the  point  p  e  R  from  the  line  t  through  p',  p"  and 
denote  by  d^v)  the  distance  of  v  e  H  from  the  convex  set  U.  Define  the  scalar 
functional  f  on  H  by 

f(v)  -  dt(*(v))  +  2Md0(v).  (4.3. 

Notice  that  f  is  globally  Lipschitz  continuous,  with  Lipschitz  constant  3m.  By  setting 
m(v)  »  inf  { lyl »  y  6  3f(v)}, 

the  elementary  properties  of  generalized  gradients  [5]  imply 
m(v)  >  M  >  0  W  e  U.  (4.4) 

Let  Z  be  the  set  of  all  continuous  paths  y  :  (0,1]  ♦  H  with  y(0)  -  p',  yd)  “  p". 

Set 

c  »  inf  sup  f  (y<?) ) 
yel  Cc [o,i] 

and  observe  that  c  >  p.  Indeed,  if  y  e  I,  by  (4.1)  to  (4.3) 

sup  f(T(C)>  >  sup  f(«n(Y(5>>>  >  p, 

ceto.i]  5e(0,D 

Wg  being  the  orthogonal  projection  on  U.  Our  next  goal  is  to  apply  the  deformation 
lemma,  proved  in  [4]  for  Lipschitz  continuous  functionals,  and  conclude  that  c  is  a 
critical  value  for  f.  We  first  check  that  the  Palais-Smale  condition  is  satisfied. 
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Lemma  1  Any  sequence  'un'n>i  in  H  such  that  f(un)  *  p/2  and  m(un>  *  ®  possesses  a 
convergent  subsequence. 

Proof.  If  u  e  U,  by  (4.4)  m(u_)  >  M.  We  can  thus  assume  that 

n  n 

d 

un  e  0  for  all  n  >  1.  Let  ij(x)  be  the  orthogonal  projection  of  x  e  R  on  the  line 

t  through  p‘,  p".  For  each  n  >  1,  define  the  unit  vector 

T)  -  [  W,(*(u  ))  -  *><u  >]  /  d#(*(u  ))  .  (4.5) 

n  ft  n  n  ft  n 

The  denominator  in  (4.5)  is  no  less  then  o/2,  hence  n  is  well  defined. 

n 

Moreover  n  e  (p"-p' ”  w^.  By  possibly  taking  a  subsequence,  we  can  assume  that  n 
n  n 

converges  to  some  unit  vector  new'*'.  Relying  on  the  assumption  b'  ),  the  lemma  will  be 

proved  by  exhibiting  a  sequence  <zn^n>i  such  that  In  •  D^i(un)  -  znl  converges  to 

zero.  The  generalized  gradient  of  f  at  un  is 
3f(un)  -  -  nn  ♦  D*(un>  +  Sn. 

with  S  *  {y  e  r^(u  );  lyl  <  2m)  .  Hence  m(u  )  ♦  0  implies  that  the  distance  between 
n  n  n 

nn  •  D+(un)  and  the  set  Sn  tends  to  zero.  Let  zn  be  the  projection  of  nn  •  D|>(un> 

on  S  ,  Then  z  e  I"  (u  )  and 
n  n  n 


lira  ln*D*(u  )  -  zl  <  lim  (ln*D*(u „)-n  *D*(u  )l+ln  -D*(u  >-z  I >  -  0. 

n—  n  n  „♦«  n  n  n  n  n  n 

By  b' )  some  subsequence  of  (un)n>1  converges. 

To  complete  the  proof  of  Theorem  3,  for  c  e  R  define  the  sets 
*c  ■  (  »  e  »i  f(u)  <  c  > 

Kc  ■  {  u  e  H;  f(u)  ”  c,  0  e  3f(u)  }. 

If  is  empty,  a  generalized  deformation  lemma  (Theorem  3.1  in  [4))  yields  the 

existence  of  a  homeomorphism  h  :  H  ♦  H  such  that 


h(u)  “  u  for  u  8  A_  A_  , 

c+p/2  c-p/2 

h(A_  )  —  a _  for  some  c  >  0. 

c+E  c-e 


If  )  J  !  is  a  path  for  which 


max  f (Y(C) )  <  c  +  e, 

Ce(0,1) 
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than  tha  path  Y'(')  “  h(y(*))  lies  in  £  and 

max  fCr'tO)  <  c  -  e, 

C«(0.1] 

contrary  to  tha  definition  of  c.  This  proves  the  existence  of  some  u  e  H  for  which 
0  e  »f(u>  and  f (u)  “  c  >  p.  By  (4.4),  u  e  0.  Setting 
n  “  l«t<4(u))  -  ♦<u))/dt(t(u))  one  has 
0  e  9f(u)  C  r^u)  -  n*D4(u). 

This  swans  n*og(u)  e  r^(u),  hence  <  D4(u)»y,  n  >  <  0  lor  a 11  y  e  T( u).  On  the  other 
hand,  the  cosgwctneas  of  the  reachable  set  f(0)  implies  the  existence  of  sosw  u  e  U 
for  which 

<  4(u),  n  >  -  sax  {  <  *(u),  n  >  i  u  e  u). 

Since  4  is  continuously  differentiable  on  a  neighborhood  of  U,  u  satisfies  the 
necessary  conditions  for  optiswlity,  i.e.  <  D4(u)*y,  n  >  <  0  for  all  y  6  I"(u). 

However,  u  l  u  because 

<  D4(u).  n  >  >  <  p‘,  n  >  >  <  Wu),  n  >  ♦  p. 

This  contradicts  the  uniqueness  assumption  a')  and  proves  the  theorem. 


5.  Proof  of  Theorem  2 

Since  G  is  C1  and  the  sets  R(t)  are  uniformly  bounded  for  0  <  t  <  T,  it  is 
known  that  the  siap  4  :  u(*)  ♦  x(u,T)  is  continuously  Frechet  differentiable.  By  (2.2), 

ID4<u)l  is  uniformly  bounded  as  u  ranges  on  a  suitable  small  neighborhood  of  U. 
Moreover,  4(0)  «  R(T)  is  compact .  Let  w  e  A  and  n  e  w^,  n  »*  0.  it  will  be  shown 
that  4  satisfies  the  assumptions  a'),  b' )  stated  for  f  in  Theorem  3.  Let  u(*)  e  V 
be  an  adsuLssibie  control  for  which 

<  D4(u)*y,  n  >  <  0  Vy  e  Hu)  (5.1) 

Let  u(*)  be  any  control  in  U  and  take  y(»)  “  u(*)  -  u(»)  6  T(u).  Using  (2.3),  (5.1) 
yields 

T  _ 

/  X(s)  G(x(u,s))  (u(s)  -  u(s))ds  <  0  (5.2) 

0 


with  X(*)  defined  at  (2.4).  Since  u(*)  was  an  arbitrary  control  in  U,  u( • )  yields 
a  solution  of  the  Pont ry agin  equations  (1.8).  The  u  jueneaa  assumption  a)  thus  implies 
a*  ). 

Now  consider  a  sequence  of  controls  un( • )  e  u  and  linear  functionals  on 

L2( [0,Tl »H*) ,  say  z  (•),  with  z  e  r^(u  >,  n  •  1,  2,  ....  such  that 
n  n  n 

lim  ln*D4(u  )  -  z  I  “  0.  (5.3) 

n*w  ”  n 

Setting  1  ( • )  to  be  the  unique  solution  of 
n 

X  (t)  "  -X  (t)  G  (x(u  ,t))u  (t),  X  (T)  “  n,  (5.4) 

n  n  x  n  n  n 

condition  (5.3)  can  be  written  as 

lim  f  /T  X  (t )S(x)(u  ,t))*v  (t)dt 
u  n  n  n 

(5.5) 

"  £  zn(tl  Vn(t)  “  ° 

for  every  bounded  sequence  (v  )  ^ ( !0,T] |RB) . 

Since  u  (t)  e  a  for  all  n  and  a.e.  t  e  (0,T),  the  trajectories  x ;  (• )  -  x(u  ,•) 
n  n  n 

are  uniformly  Lipschitz  continuous,  and  the  Base  is  true  for  the  adjoint  vectors 

Xn ( • ) .  By  possibly  taking  a  subsequence  and  relabeling,  we  can  assume  that 

x  (•)  ♦  x(*)  and  X  (•)  ♦  X(*)  in  the  norm  topology  of  C°( [0,Tj »Rd) ,  while 
n  n 

u  (•)  ♦  u(*)  weakly,  for  some  x(»),  X<*),  u(»).  Por  every  t  e  [0,TJ 
n 

x  (u  ,t)  “  G(x  (s))u  (s)ds, 
n  n  u  n  n 

X  (t)  -  h  +  jT  X  (s)  G  <x  (s))  u  (s)ds. 
n  t  n  x  it  n 

Letting  n  ♦  «•  in  the  above  equalities,  we  obtain 

x(t)  ■  Jq  G(x(s) )u(s)ds,  (5.6) 

X(t)  *  h  +  /*  X(s)  Gx(x(s))u(s)ds.  (5.7) 

Therefore  x( • )  is  actually  the  trajectory  of  (1.1)  corresponding  to  the  control  u( • ) 

and  X( • )  solves  the  correct  adjoint  equation  in  (1.8).  The  maximality  condition  in 

(1.8)  also  holds.  Indeed,  let  u(')  e  U.  Since  U  is  bounded,  such  is  the  sequence 

v  (•)  »  uC)  -  u  (•). 
n  n 


Thus  (5.5)  implies 


0  ■  lim  [  f*  X  (t)  G(x(u  ,t))*(u(t)  -  u  (t))dt  -  z  (t)  (u(t)  -  u  (t))dt] 

'■'On  n  n  'On  n  ' 

n*~ 

>  /*  T(t)  G(x(t))  (u(t)-u(t))dt  (5.8) 

becauae,  by  (2.5),  j*  xn(t)  (u(t)  -  un<t))dt  <  0  for  all  n  >  1.  Since  u(»  )  e  0  was 
arbitrary,  (5.8),  together  with  (5.6)  and  (5.7),  shova  that  u(*),  x(*),  X(*)  afford  a 
solution  to  (1.8).  Therefore  the  strong  uniqueness  condition  b)  can  now  be  Invoked. 
Intuitively,  b)  states  that  u(«)  ia  an  exposed  point  of  U,  hence  the  convergence 
un(*)  ♦  u(*)  takes  actually  place  in  the  norm  topology  of  t?  ( [0,T] >  R  )  as  well,  k 

precise  argument  runs  aa  follows.  Suppose  that  un ( • )  did  not  converge  to  u  in  the 

L2-norm.  Then,  because  of  the  boundedness  of  0,  there  exist  c  >  0,  a  subsequence 
uv  and  a  aet  J  C  (0,TJ  with  positive  Lebesque  measure  such  that  luv(t)  -  u(t)|  >  c 
for  t  e  J  and  all  v  >  1.  For  t  6  J,  set 
6(t)  »  <  X(t),  G(x(t))u(t)  >  -max  {<X(t),  G(x(t))u  >  t  a  e  0,  |u  -  u(t)|  >  e  }  . 

5 (• )  ia  measurable  and  strictly  positive  a.e.  on  J,  hence 

6  -  Jj  6 (t )dt  >  0. 

For  each  v  >  1,  define  vv(t)  "  u(t)  -  u^t)  if  t  e  J,  vy(t)  “0  if  t  e  J.  Clearly 

v,(*)  C  Hu,.).  Recalling  that  in  (5.3)  z  e  rX(u  ),  one  has 

v  v  n  n 

Jo  V8'  G  (*v<»))vv(s)ds  -  J*  zv(a)vx|(8)d« 

>  / _  X  (s)  G(x  (s))v  (s)da 

>  Jj  X ( 8 )G(x( S) )  Vv(8)ds  -  Jjl^vts)-X(s)|*|G(x(s))  |•(vv(s)|ds 

-  /j  |Xv(s)|«|G(xv(a))  -  G(x(s))Mvv(s)|ds  (5.9) 

Since  the  sequence  vy  is  bounded,  by  (5.5)  the  left-hand  side  of  (5.9)  tends  to  zero  as 

v  ♦  ».  However,  the  first  integral  on  the  right-hand  side  of  (5.9)  is  >  S  for  all 

v,  while  the  other  two  integrals  tend  to  zero.  This  yields  a  contradiction  and 
establishes  the  strong  convergence  of  the  sequence  un  to  u.  Theorem  3  can  thus  be 
applied,  completing  the  proof. 
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